Spin-liquid and magnetic phases in the anisotropic triangular lattice: 

the case of k-(ET)2X 
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The two-dimensional Hubbard model on the anisotropic triangular lattice, with two different 
hopping amplitudes t and t' , is relevant to describe the low-energy physics of k-(ET)2X, a family of 
organic salts. The ground-state properties of this model are studied by using Monte Carlo techniques, 
on the basis of a recent definition of backfiow correlations for strongly-correlated lattice systems. 
The results show that there is no magnetic order for reasonably large values of the electron-electron 
interaction U and frustrating ratio t' /t = 0.85, suitable to describe the non-magnetic compound with 
X=Cu2(CN)3. On the contrary, Neel order takes place for weaker frustrations, i.e., t' /t ~ 0.4 0.6, 
suitable for materials with X=Cu2(SCN)2, Cu[N(CN)2]Cl, or Cu[N(CN)2]Br. 



PACS numbers: 71.10.Fd, 71.27.-fa, 71.30.+h, 75.10.-b 
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I. INTRODUCTION 

Organic charge-transfer salts show a wide variety of 
quantum phases and represent prominent examples to 
study correlation effects in low-dimensional systems. The 
most celebrated case is given by the TTF-TCNQ salt that 
has been primarily regarded as a prototype for testing 
theories of one-dimensional conductorsii Organic salts 
may also form crystals in two and three dimensions, and, 
in this respect, an increasing attention has been devoted 
to a particular family denoted by k-(ET)2X, whose build- 
ing block is the so-called BEDT-TTF (or FT) molecule 
and X is a monovalent anion Here, strongly dimerized 
ET molecules are arranged in a two-dimensional trian- 
gular lattice. Each dimer has a charge state with one 
hole and therefore the conducting band is half filled. A 
sizable effective Coulomb repulsion is felt by two holes 
on the same dimer. A huge variety of phases have been 
found (by varying temperature, pressure or the nature 
of the anion X), ranging from correlated (bad) metals 
with superconductivity at low temperatures, to Mott in- 
sulators with magnetic order i^i^i^i^ Interestingly, by act- 
ing with hydrostatic pressure, metal-insulator transitions 
have been observedj^i^ with the remarkable possibility 
to stabilize a non-magnetic Mott insulating phase in k- 
(ET)2Cu2(CN)3.~ In this material, there is no evidence 
of magnetic order down to T ~ SOmK , which is four or- 
ders of magnitude lower than the estimate of the super- 
exchange coupling J ~ 250K. 

It has been argued that k-(ET)2X compounds can 
be described by a single-band Hubbard model on the 
anisotropic triangular lattice, where chains described 
by an hopping f are coupled together with zig-zag hop- 
pings t, see Fig. [T] An on-site repulsive term U is also 
present in the Hamiltonian. However, a realistic esti- 
mate of these microscopic parameters is not exempt from 
complications. Indeed, the values obtained some time 



ago by extended Hiickel band structure calculationsii 
have been put in doubt by two recent ab-initio calcu- 
lations, based upon local-density approximation (LDA) 
and generalized gradient approximation (GGA)J^^ In- 
terestingly, the new results suggest that these organic 
salts are less frustrated than previously assumed, and 
that t' /t is smaller than one. Indeed, the frustrating 
ratio is i'/t - 0.8 for k-(ET)2Cu2(CN)3 and t'/t - 
0.6 for K-(ET)2Cu2(SCN)2-i^ii^ Other materials, with 
X=Cu[N(CN)2]Cl or Cu[N(CN)2]Br, have a substantially 
smaller frustrating ratio, i.e., t'/t ~ 0.4?^^ Unfortunately, 
an accurate determination of the correlation energy is 
rather difficult and these two calculations give a con- 
siderably different estimation of the Coulomb repulsion, 
namely U/t - 12^15 (Ref.|I3) and U/t - 5H-7 (Ref.[i3). 

Here, we apply our improved Monte Carlo calculations, 
based upon the recently introduced backflow wave func- 
tiorti^ in order to analyze the possibility of having a non- 
magnetic insulator for large enough frustration and in- 
teraction strength. 

The paper is organized as follow: in section [Hi we in- 
troduce the Hamiltonian; in section HITl we describe our 
variational wave function; in section IIVI we present our 
numerical results and, finally, in section |V] we draw the 
conclusions. 



II. MODEL 

We consider the Hubbard model described by 

H = - ^ iycI,^Cj> + H.c. + C/^ni,|n,,4, (1) 

where c] ^{ci^a) creates (destroys) an electron with spin 

a on site i, ni,a — cl^Ci^g-, tij is the hopping amplitude 
and U is the on-site Coulomb repulsion. In this work, we 
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III. VARIATIONAL APPROACH 

A variational wave function for an insulator with anti- 
ferromagnetic (AF) order can be constructed by consid- 
ering the ground state \AF) of a mean- field Hamiltonian 
containing a band contribution and a magnetic term: 



(2) 



FIG. 1: Illustration of the lattice in the square topology (a) 
used in this work and in the equivalent triangular one (b). 
Solid and dashed lines indicate hopping amplitudes t and t' , 
respectively. 
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FIG. 2: (Color online) Results for 18 electrons on 18 sites 
as a function of U/t. Upper panels: Accuracy of energy 
AE — {Eq — Ev), Ev and Eq being the variational and the ex- 
act values, respectively. Lower panels: Overlap between the 
exact ground state and the variational BCS wave functions. 
The state without (with) backflow correlations is denoted by 
diamonds (squares). 



where n.; is a unitary vector that depends upon the lat- 
tice site i and Sj = {Sf,Sf,Sf) is the spin operator. 
Moreover, = —2t{cosqx + cosqy) — 2tdC0s{qx + Qy) is 
a variational band term: t gives the energy scale and td 
can be optimized to minimize the variational energy. In 
order to correctly describe spin fluctuations orthogonal 
to the plane where the magnetic order lies, we take 
in the x—y plane and we include a spin Jastrow factor 
Js = exp[— ^ J- UijS'f 5J] in the wave function.^"* An- 
other density Jastrow factor ~ exp[— i ^- jnjrij] 
(that includes the on-site Gutzwiller term) is considered 
to adjust electron correlations. In summary, the corre- 
lated wave function is defined by 



) = JsJ\AF). 



(3) 



Notice that, in this case, the variational state has not a 
definite total spin, which is suitable for a magnetically 
ordered phase. In fact, both \AF) and the spin Jastrow 
factor J7s break the SU(2) symmetry. 

On the other hand, superconducting or metallic phases 
can be constructed by considering the ground state 
\BCS) of a superconducting Bardcen-Cooper-Schricffer 
(BCS) Hamiltonian with both band and pairing contri- 
butions<2^i^ 



T-Lbcs = X! ^-J^:' 



Ha 



(4) 



focus our attention on the half-filled case with N elec- 
trons on N sites and consider a square lattice with a 
nearest-neighbor hopping i, along the (1,0) and (0,1) 
directions, and a further next-nearest-neighbor hopping 
t' along (1,1); this choice of the hopping amplitudes 
is topologically equivalent to the anisotropic triangular 
latticCfii. see Fig. [1] In the last years, an intense ef- 
fort has been devoted to this problem by use of a large 
variety of methods, including exact diagonalization,^^ 
path-integral renormalization group, variational Monte 
CarlOfiSiiSii^ cluster dynamical mean field theoryj^i^ 
and dual Fermions.^^ All these methods give rather dif- 
ferent outcomes and there are huge discrepancies on the 
phase boundaries and, most importantly, on the expected 
nature of the non-magnetic insulator. The aim of this 
work is to clarify the ground-state properties for two val- 
ues of t' /t = 0.6 and 0.85, relevant for materials with 
X=Cu2(SCN)2 and Cu2(CN)3, respectively. 



here the band term may also contain a variational chemi- 
cal potential fx, since the BCS Hamiltonian does not con- 
serve the particle number, i.e., = — 2f(cos g^: -|-cos qy) — 
2tdC0s{qx + qy) — ^. In this case, td and /j, can be var- 
ied to optimize the variational wave function. The full 
correlated state is given by 



\^Bcs)^J\BCS), 



(5) 



in this case, no spin Jastrow is considered, in order to 
have a perfect singlet state, suitable for a non-magnetic 
phase. Notably, within this kind of wave function, it 
is possible to obtain a pure (i.e., non- magnetic) Mott 
insulator just by considering a sufficiently strong Jastrow 
factor, i.e., Vq ~ l/f?^ {vq being the Fourier transform of 

As we recently demonstrated,^"' the projected BCS 
state is not sufficiently accurate for Hubbard-type mod- 
els, especially in the important strong-coupling regime, 
i.e., for U/t > 10, where the super-exchange energy scale 
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FIG. 3: (Color online) Variational energies per site (in unit of 
J = At^ /U) for the BCS state with a density Jastrow factor 
(diamonds) and for the AF wave function with both density 
and spin Jastrow terms (circles); The correlated Fermi gas 
with Jastrow factor is also reported for t' /t = 0.85 (squares). 
All states have backflow correlations and results are for 100 
sites. 

J ~ At'^/U is not correctly reproduced. One efficient way 
to overcome this problem is to consider backflow correla- 
tions,"'^'' that modify the single-particle orbitals,^^ in the 
same spirit of what was put forward long-time ago by 
Feynman and Coheni^ 

Following Ref. [3, we consider a general definition of 
the new "orbitals" by taking all the possible virtual hop- 
pings of the electrons: 

j 

j 

3 

where we used the notation 4>q(Yi^^) = {Q\ci^a\4'q)^ be- 
ing \(f)q) the eigenstates of the mean-field Hamiltonian, 
Di = 7iijnj_|, Hi = hi^^hi^i, with hi^^, = (l-"j,o-)- e, 
772, and 773 are variational parameters. As a consequence, 
already the determinant part of the wave function in- 
cludes correlation effects. The backflow corrections of 
Eq. ^ (in particular the ryi term) make it possible to 
mimic the effect of the virtual hopping, which leads to 
the super-exchange mechanism. All the parameters of 
the wave function can be optimized by using the method 
of Ref. 

Finally, the accuracy of the variational calculations can 
be assessed by using Lanczos diagonalizations on small 
lattices and Green's function Monte Carlo within the so- 
called fixed-node approximation,'^^ which gives accurate 



(but approximate) results on large systems. A detailed 
description of the fixed-node approximation can be found 
in Ref. [sH. In brief, starting from the original Hamilto- 
nian 7i, we define an effective Hamiltonian by adding a 
perturbation O: 

Heff^n + O. (7) 

The operator O is defined through its matrix elements 
and depends upon a given guiding function \^!), that is 
for instance the variational state itself 

{—Tix'.x \i xi ^ X and Sx'^x > 

ff X/ ^ X and Sx',x < 

Ey:sy,^>o'^y,=c^ forx' = 

where ^x = and Sx',x = 'i'x''Hx',x'i'x- Notice 

that the above operator annihilates the guiding function, 
namely 0|'I') = 0. Therefore, whenever the guiding func- 
tion is close to the exact ground state of ?i, the pertur- 
bation O is expected to be small and the effective Hamil- 
tonian becomes very close to the original one. 

IV. RESULTS 

By allowing the most general singlet and complex BCS 
pairing in the state without backflow terms, we find 
that this quantity has dx2_y2 symmetry up to t' ^ t, 
namely the best (nearest-neighbor) pairing function is 
Aq = 2 A (cos (7a; — cosqy), in agreement with previous re- 
sults >^>^i^!^ Therefore, within our improved backflow 
wave function, we only considered a real BCS pairing. 
We mention that A is very small (especially in the pres- 
ence of backflow correlations) in the conducting phase, 
see table HI and it becomes sizable only in the regime 
where the magnetic solution prevails over the BCS state. 
In this regard, we do not find a clear signature of su- 
perconductivity close to the metal-insulator transition, 
as suggested in Ref. [sH. We also stress that, once the 
backflow correlations are considered, there is no energy 
gain by allowing a translational symmetry breaking (e.g., 
by considering a 2 x 1 unit cell in the BCS Hamiltonian, 
suitable for dimerized states) and the dx-^-y^ solution has 
always a lower energy than dimerized states. Finally, we 
find that the variational band term of the BCS Hamilto- 
nian eq — —2t{cosqx + cosQy) — 2tdC0s{qx + qy) — has 
td — Q for most of the cases considered, except for small 
U /i, inside the conducting phase, where a finite td can 
be stabilized. 

As far as the magnetic wave function is concerned, 
both Hartree-Fock and fixed-node calculations give a 
clear indication that spin-spin correlations remain com- 
mensurate at Q = (tt, tt) for t' /t < 0.9. Therefore, we use 
an AF wave function having Neel order with pitch vector 
Q = (tt, tt) and we do not consider the implementation 
of a generic magnetic state with incommensurate order. 
Moreover, we verified that, for t' /t < 0.9, this AF state 
has a lower energy with respect to the AF state with 120° 
order, suitable for t' = t. 
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TABLE I: BCS pairing A for various U /t in the metallic region 
for two sizes of the lattice: A'' = 100 (third column) and N = 
196 (fourth column). Notice that for U /t = 8 and t' /t = 0.85 
and for U /t = 6 and t' /t — 0.6 the BCS wave function is still 
metallic but the AF one (insulating) has a lower variational 
energy. 

U/t t'/t A/t A/t 

6 0.85 0.026(1) 0.018(1) 

7 0.85 0.051(1) 0.025(1) 

8 0.85 0.161(1) 0.037(1) 

~ 0.6 0.013(1) 0.005(1) 

5 0.6 0.027(1) 0.008(1) 

6 0.6 0.056(1) 0.019(1) 



TABLE II: Our best energies per site for N = 100: pure 
variational Evmc and fixed-node Efn (still variational) results 
are reported. 
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(e.g., (^ol^-Af ) = 0.904 against {^q\^bcs) = 0-959). 

The accuracy of the variational state remains very high 
also for large systems, where the backflow corrections give 
a sizable and size-consistent improvement. In Fig. [31 we 
report the energy per site as a function of U/t for both 
t'/t = 0.6 and 0.85 for = 10 x 10 (see also table HI]). 
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FIG. 4: (Color online) Variational results for the density- 
density correlations Nq divided by |g|, along the (1,0) direc- 
tion, for 100 (red symbols) and 196 (black symbols) sites. Full 
(empty) symbols refer to the BCS (AF) wave function. Upper 
panel: from top to bottom, C//t = 4, 5, 6, 8, and 10. Lower 
panel: from top to bottom, U/t — 6, 7, 8, 10, and 20. 



A. Quality of the variational states 

In Fig. [21 we show the accuracy of the BCS variational 
state and its overlap with the exact ground state in a 
small lattice with 18 sites (which is tilted by 45 degrees). 
We report two cases with t'/t — 0.6 and 0.85 and differ- 
ent values of U/t. As in the case of the frustrated square 
lattice studied in Ref. 14, the backflow terms highly im- 
prove the quality of the variational wave function that 
remains very accurate even for large correlation, i.e., up 
to U/t ~ 30. We would like to mention that, for this 
small cluster, the AF state has a slightly lower energy 
than the BCS one for both t'/t = 0.6 and 0.85. For 
t'/t = 0.6, the AF state has also a better overlap with 
the exact ground state |*o) (e.g., (^'o|*af) = 0.962 for 
U/t = 20) than the BCS state (e.g., (*o|*scs) = 0.958), 
while it has a substantially lower overlap for t'/t = 0.85 



B. Metal-insulator transition 

The metal-insulator transition can be detected by a 
direct inspection of the static density-density correlations 



rijUi). 



(8) 



In fact, this quantity makes it possible to discriminate 
between gapless (conducting) and gapped (insulating) 



phases: a linear behavior N„ 



for 



is typi- 



cal of a conducting phase, whereas a quadratic behavior 
Nq ^ can be associated to an insulating characteri^ 
The results presented in Fig. [4] indicate that a metal- 
insulator transition takes place by increasing U/t and it 
can be placed at U^^'^/t = (5.5 ± 0.5) and (7.5 ± 0.5) 
for t'/t = 0.6 and 0.85, respectively. The transition is 
first order, with a small jump in the linear coefficient of 
Nq for small momenta. In fact, for small U/t, the best 
wave function is the BCS one (with small superconduct- 
ing pairing), whereas, by increasing the interaction, the 
AF one prevails, thus inducing a metal-insulator transi- 
tion, see Fig. [31 



C. Insulating Phase 

In the insulating regime and for small frustrating ra- 
tios, the AF wave function has always a lower energy than 
the spin-liquid state, and this fact is particularly evident 
close to the transition, see Fig. [3l On the contrary, for 
the case with t'/t = 0.85, the BCS state competes with 
the AF one and it becomes better in energy ioiU/t> 13, 
indicating an insulating spin-liquid behavior at large U 
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guiding function. We stress the fact that, in the insulat- 
ing regime, Sq has a peak at the commensurate momen- 
tum Q = (tt, tt). Remarkably, the fixed- node approach 
is able to recover a finite value of Sq /N for Q — (tt, tt) 
(i.e., the square of the magnetic order parameter) in the 
thermodynamic limit for t' /t = 0.6, even though the BCS 
wave function is non magnetic. By contrast, Sq/N tends 
to zero for t'/t = 0.85 (both for U/t = 10 and 20), sup- 
porting the fact that the ground state is non magnetic 
for this frustrating ratio, even close to the metal-insulator 
transition. The resulting phase diagram is summarized 
in Fig. E 



FIG. 5: (Color online) Size scaling of the spin-spin correla- 
tions Sq/N for Q — {n,n). Data are for t'/t = 0.6 with 
U/t = 10 (squares) and U/t = 20 (circles), and t'/t = 0.85 
with U/t = 10 (triangles) and U/t = 20 (diamonds). Varia- 
tional and fixed-node results are denoted by empty and full 
symbols, respectively. The variational results do not depend 
substantially upon U and t' . The fixed-node results indicate 
long-range order for t'/t = 0.6 but not for t'/t — 0.85. 
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FIG. 6: (Color online) Proposed phase diagram for the two 
discussed hopping ratios, t'/t = 0.6 and t'/t — 0.85. In the 
first case, variational (VMC) and fixed-node results (FN) indi- 
cate both a direct transition between a metal and an insulator 
with AF Neel order at a critical value of the electron-electron 
repulsion Uc- For t'/t = 0.85, the variational results pre- 
dict the existence of three different phases at increasing U/t: 
a metal, an AF insulator with Neel order and a spin liquid, 
while, within the fixed-node approximation, the non-magnetic 
ground state extends down to the metal-insulator transition. 



(notice that in this region Nq ^ q^). In this regime, the 
BCS pairing is relevant, since the simple projected Fermi 
sea has a much higher energy, see Fig. [31 Remarkably, 
the BCS and AF variational energies are always quite 
close for t'/t = 0.85, suggesting that the actual ground 
state might be non-magnetic for all U > U^^'^ , or at 
least down to values lower than expected on the basis of 
the variational estimate. This fact is supported by the 
fixed-node calculations for the spin-spin correlations 
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(9) 



In Fig. [HI we report the size scaling of the variational and 
the fixed-node results by considering the BCS state as the 



V. DISCUSSION 

We have studied the anisotropic triangular lattice at 
half filling away from the isotropic point t' = i, with 
t' < t, using both a Gutzwiller-Jastrow variational ansatz 
including backflow correlations as well as a Green's func- 
tion Monte Carlo approach within the fixed node approx- 
imation. We find that the square lattice states persist up 
to large values of t'/t < 1, both in terms of the d-wave 
superconducting order parameter as well as for the AF 
Neel ordering. 

The main outcome of this work is that, thanks to the 
improvement given by backflow correlations, a spin-liquid 
wave function can be stabilized over magnetic states, for 
large but still moderate Coulomb repulsions and close 
to the isotropic limit. These variational results are cor- 
roborated by fixed-node calculations. We find, in par- 
ticular, that for t'/t = 0.85, which is relevant for k- 
(ET)2Cu2(CN)3fi^iH the insulating phase has a pure 
Mott character, without magnetic order. On the other 
hand, for t'/t = 0.6, suitable for k-(ET)2Cu2(SCN)2, 
(or even smaller t'/t values) the insulating phase always 
shows Neel order with Q = (tt, tt). 

Let us finish by discussing our results also in compari- 
son to other calculations and experimental findings. First 
of all, in various papers, it has been suggested that the 
spin-liquid phase can be stabilized by charge fluctuations 
that may destabilize a magnetically ordered state. This 
claim has been corroborated by calculations on Heisen- 
berg models in presence of a ring-exchange term J4 (that 
appears in the strong-coupling expansion in t'^/U^)M- 
However, it turns out that the actual value of J4 for sta- 
bilizing a disordered phase is rather large and, probably, 
beyond the validity of a perturbative expansion. The ex- 
istence of a direct transition from a magnetic phase to a 
disordered one has been also found in the original Hub- 
bard model, by decreasing the on-site repulsion U i^^, 17,21 
We do not find any evidence of such a possibility and, in 
our approach, the magnetic phase is stable in presence 
of charge fluctuations, even close to the metal-insulator 
transition: this is the case of t'/t = 0.6. Instead, the 
spin-liquid phase turns out to be directly connected with 
the one at strong coupling, while antiferromagnetic corre- 
lations become stronger when decreasing U/t. For exam- 
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pie, for t' jt = 0.85, the variational state with magnetic 
order has a slightly lower energy close to and we need 
to apply the Green's function Monte Carlo approach to 
extend the spin-liquid region down to the metal-insulator 
transition, see Fig. [H] At this stage, we would also like 
to mention that the metallic phase is likely to be not su- 
perconducting. In fact, the BCS pairing A in the metal- 
lic region is slightly suppressed when improving the ac- 
curacy of the variational wave function by considering 
backflow correlations and, moreover, it is reduced by a 
factor 2 — 3 when the lattice size is increased from 10 x 10 
to 14 X 14, see table HI This fact contrasts the previous 
claim of a possible superconducting phase close to the 
metal-insulator transition by Liu and collaborators!^ 

Another very important point is to clarify the nature 
of the low-energy excitations. Very recently, thermody- 
namic measurements of the specific heat suggested the 
possible existence of a Fermi surface of neutral, S* = 1/2 
fermionic spinonsi^ However, it should be noticed that 



such a measurement involves a difficult subtraction of a 
divergent nuclear specific heat, and instead the thermal 
conductivity (which is not affected by a nuclear contri- 
bution) shows an activated behavior with a tiny gap of 
^.A&K?'^ This fact has been associated with the existence 
of spinless "vison" excitations. From our calculations, 
it appears that the disordered insulating phase cannot 
sustain a true spinon Fermi surface, as previously sug- 
gested both on variational calculations^ and field-theory 
approaches)^ but it has Dirac points at (±7r/2, ±7r/2). 
In fact, the projected Fermi-sea has a much higher en- 
ergy than our best variational ansatz with BCS pairing, 
see Fig. [3l Should our results be correct, either a deeper 
investigation of the minimal microscopic model for de- 
scribing organic charge-transfer salts is needed or a rein- 
terpretation of the experimental data is required. 

We thank R. Valenti for very useful discussions. L.T. 
and C.G. thank partial support from the German Science 
Foundation through the Transregio 49. 
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